Method and apparatus for taking images during a video call on a mobile communication terminal

ABSTRACT

A method and apparatus for taking images while making a video call on a mobile communication terminal having a video call feature are provided. A method for taking images on a mobile communication terminal including a camera sensor for photographing an image to output an image signal and a signal processor receiving the image signal from the camera sensor to convert the image signal to image data includes determining whether there is a request to take an image during a video call and extracting, if there is a request to take an image, the image signal output from the camera sensor, converting the image signal to image data for storage, and storing the image data while performing the video call. The method enables production and storage of image data using a controller instead of a signal processor functioning for performing a video call.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.11/819,605, filed on Jun. 28, 2007, which claims the benefit under 35U.S.C. §119(a) of Korean Patent Application Serial No. 2006-0070922,filed with the Korean Intellectual Property Office on Jul. 27, 2006, theentire contents of both of said prior applications being herebyincorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a mobile communication terminal havinga video communication function. More particularly, the present inventionrelates to a method for taking images while making a video call on amobile communication terminal.

2. Description of the Related Art

In general, a mobile terminal refers to a terminal that is carried by anindividual user and supports various functions using applicationprograms including wireless communication services. Examples of a mobileterminal may include a personal mobile communication services terminal,a personal digital assistant (PDA), a smart phone, an internationalmobile telecommunication 2000 (IMT-2000) terminal, and a wireless localarea network (LAN) terminal.

Generally, a mobile terminal has voice calling and short message service(SMS) functions. However, recent, rapid development of mobilecommunication technology has allowed a mobile terminal to supportdiverse and sophisticated functions including video calls, anelectronic-note function, audio/image storage, Internet access, andentertainment features. Furthermore, with the advent of a mobileterminal having a digital camera function in addition to the abovefeatures, users can easily take motion video images and still images(collectively referred to as “images”), can store the images, use theimages as wallpaper, or transmit the images via e-mail or by anothermessaging function to another mobile communication terminal.

The use of the digital camera function also has contributed to therecent development and commercialization of a video calling system. Thevideo calling system enables callers to see images of each other duringvoice conversations by transmitting the images input to a digital camerato the other party's mobile communication terminal.

That is, video calling features allow a user to send their currentimages and voice information to another party's mobile communicationterminal through their own terminal and receive the other party's imagesand voice information from the other party's terminal. Thus, the usercan see images of the other party on their terminal during phoneconversations.

However, a conventional mobile communication terminal has a problem inthat still images cannot be taken during a video call. When theconventional mobile communication terminal is connected to anotherparty's terminal for making a video call, a video calling program isloaded into a signal processor. The signal processor then converts animage signal, input through a camera sensor, into low resolution digitaldata for transmission over a wireless link. Thus, even if a user'srequest to take a still image is received during a video call, thesignal processor cannot perform the task in response to such a request.

Thus, in order to take high quality images during a video call, theconventional mobile communication terminal must first terminate thevideo call and then convert a video call mode into a still image mode ormotion video mode, thus causing user's inconvenience. That is, theconventional mobile communication terminal cannot separately take andstore high quality still images or motion video images while making avideo call.

Accordingly, there is a need for an improved method and apparatus fortaking images during a video call on a mobile communication terminal.

SUMMARY OF THE INVENTION

Exemplary embodiments of the present invention address at least theabove problems and/or disadvantages and provide at least the advantagesdescribed below. Accordingly, an aspect of the present invention is toprovide a method and apparatus for taking images on a mobilecommunication terminal that can store an image signal input through adigital camera as high quality image data while making a video call.

In order to achieve the above object, according to an exemplaryembodiment of the present invention, there is provided a method fortaking images on a mobile communication terminal, including determiningwhether there is a request to take an image during a video call andextracting, if there is a request to take an image, an image signaloutput from a camera sensor and storing the extracted image signal whileperforming the video call.

In an exemplary embodiment, a method for taking images on a mobilecommunication terminal includes determining whether there is a requestto take an image during a video call, extracting, if there is a requestto take an image, an image signal output from a camera sensor,converting the image signal to image data for storage, and temporarilystoring the image data, while performing the video call, terminating thevideo call and storing the temporarily stored image data.

In accordance with an exemplary embodiment of the present invention,there is provided a mobile communication terminal including a determinerfor determining whether there is a request to take an image during avideo call, an image extractor for extracting, upon receipt of a signalindicating a request to take an image from the determiner, an imagesignal output from a camera sensor during the video call, an imageconverter for converting the image signal extracted by the imageextractor into image data for storage and an image storage unit forstoring the image data output from the image converter.

In an exemplary embodiment, the apparatus further includes an imageprocessor for displaying the image data stored in the image storage uniton a screen and deleting, upon request for deletion, the displayed imagedata.

A controller of the mobile communication terminal, according to anexemplary embodiment includes the determiner, the image extractor, theimage converter, and the image processor. A storage unit, according toan exemplary embodiment may include the image storage unit for storingimage data.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other objects, features and advantages of the presentinvention will be more apparent from the following detailed descriptionin conjunction with the accompanying drawings, in which:

FIG. 1 is a schematic block diagram illustrating a configuration of amobile communication terminal according to an exemplary embodiment ofthe present invention;

FIGS. 2A and 2B are a flowchart illustrating a method for taking imageson a mobile communication terminal according to an exemplary embodimentof the present invention; and

FIGS. 3A and 3B are a flowchart illustrating a method for taking imageson a mobile communication terminal according to another exemplaryembodiment of the present invention.

Throughout the drawings, the same drawing reference numerals will beunderstood to refer to the same elements, features, and structures.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

The matters defined in the description such as a detailed constructionand elements are provided to assist in a comprehensive understanding ofthe embodiments of the invention and are merely exemplary. Accordingly,those of ordinary skill in the art will recognize that various changesand modifications of the embodiments described herein can be madewithout departing from the scope and spirit of the invention. Also,descriptions of well-known functions and constructions are omitted forclarity and conciseness. Hereinafter, exemplary embodiments of thepresent invention are described in detail with reference to theaccompanying drawings. Dimensions of the elements or spacing betweenelements are not to scale.

FIG. 1 is a schematic block diagram illustrating the configuration of amobile communication terminal 100 according to an exemplary embodimentof the present invention.

Referring to FIG. 1, the mobile communication terminal 100 includes acontroller 90, a wireless communication unit 20, an audio processor 30,a key input unit 40, a camera module 50, an image processor 60, adisplay unit 70, and a storage unit 80. The camera module 50 includes acamera sensor 52 and a signal processor 54.

The wireless communication unit 20 transmits and receives data forwireless communication. To achieve this function, the wirelesscommunication unit 20 includes an RF transmitter that up-converts andamplifies the frequency of a signal being transmitted and an RF receiverthat low-noise amplifies a signal being received and down-converts itsfrequency. The wireless communication unit 20 receives data via awireless channel to output the data to the controller 90 and receivesdata from the controller 90 to transmit the data through the wirelesschannel.

The audio processor 30 includes a coder/decoder (CODEC). The CODECconsists of a data codec for processing data such as packet data and anaudio codec for processing audio signals such as voice. The audioprocessor 30 converts a digital audio signal fed into the controller 90to an analog signal during a voice call on the mobile terminal 100through the audio codec and plays the analog signal through a speaker.The audio processor 30 also converts an analog audio signal receivedthrough a microphone to a digital audio signal through the audio codecand transmits the digital audio signal to the controller 90.

The key input unit 40 receives a user's manipulation signal forcontrolling the mobile communication terminal 100 to transmit the signalto the controller 90. To achieve this function, the key input unit 40includes multiple character keys (not shown) for inputting numeric andcharacter information and control keys (not shown) for controlling theoperation of the mobile communication terminal 100. An exemplary keyinput unit 40 of the present invention further includes an image-takingkey 42 for storing images (still or motion video images). In anexemplary embodiment, the image-taking key 42 may be realized inhardware together with the character keys and control keys. Theimage-taking key 42 may also however, be realized in software.

The camera sensor 52 of the camera module 50 takes an image formed by alens and converts the resulting optical signal to an electrical signal.The camera sensor 52 may be a charge coupled device (CCD) orcomplementary metal oxide semiconductor (CMOS) sensor.

The signal processor 54 of the camera module 50 converts an analog imagesignal output from the camera sensor 52 to digital data. The signalprocessor 54 may be a digital signal processor or other signalprocessor.

The image processor 60 outputs image data obtained by dividing an imagesignal received from the camera module 50 into frames to match thedisplay characteristics and size of the display unit 70. The imageprocessor 60 also compresses the image data to transmit the compresseddata to the controller 90. To achieve this function, the image processor60 includes an image codec for compressing the image data to bedisplayed on the display unit 70 using a compression technique. Theimage codec may also be used for decompressing the compressed image datainto original image data. The image codec may be a Joint PicturesExperts Group (JPEG) codec, Moving Pictures Experts Group (MPEG) codec,or Wavelet codec.

The display unit 70 displays image data output from the image processor60 on a screen. The display unit 70 may be a liquid crystal display(LCD). In this case, the display unit 70 may include an LCD controller,a memory for storing image data, an LCD display element and the like.When the LCD is implemented using a touch screen technology, the screenof the display unit 70 may function as an input portion.

The storage unit 80 may include a program memory for storing programsfor controlling the operation of the mobile communication terminal 100.The storage unit 80 may further comprise a data memory for storing datagenerated while executing the programs and still or motion video imagesinput through the camera sensor 52. The data memory may also storevarious programs loaded into the signal processor 54, such as a videocalling program, a still image program, and a motion video program.

The controller 90 performs the overall control operation of the mobilecommunication terminal 100. Upon receiving the user's request to take animage during a video call, the controller 90 converts an image signaloutput from the camera sensor 52 to image data for storage and controlsthe storage unit 80 to store the image data.

A method and apparatus for photographing an image on a mobilecommunication terminal according to exemplary embodiments of the presentinvention will now be described in detail with reference to FIGS. 1-3B.The above described configuration of the mobile communication terminal100 will also become more apparent from the following description of theexemplary method for photographing images.

FIGS. 2A and 2B are a flowchart illustrating a method for taking imageson a mobile communication terminal according to an exemplary embodimentof the present invention.

Referring to FIGS. 1-2B, in a state in which the mobile communicationterminal 100 is in a standby mode (S110), if a key input occurs, thecontroller 90 determines whether the key input represents a request fora video call (S120). If the key input represents a request for a videocall, the controller 90 loads a video calling program into the signalprocessor 54 of the camera module 50 (S130).

More specifically, a program corresponding to a mode of the mobilecommunication terminal 100 is loaded into the signal processor 54. Forexample, if the mobile communication terminal 100 is in a stillimage-taking mode, a camera program may be loaded into the signalprocessor 54. If the mobile communication terminal 100 is a in a motionvideo-taking mode, a camcorder program may be loaded into the signalprocessor 54. Similarly, as described above, when the mobilecommunication terminal 100 is in a video call mode, a video callingprogram is loaded therein.

Programs are intended for generating optimized still images, motionvideo, and video calling motion video. The programs are loaded into thesignal processor 54 by the controller 90 when necessary to drive thesignal processor 54. The programs are stored in the storage unit 80.When the mode of a built-in camera of the mobile communication terminal100 is converted to a specific mode, the controller 90 fetches a programcorresponding to the mode and loads it into the signal processor 54.

When the controller 90 loads a video calling program stored in thestorage unit 80 into the signal processor 54, the signal processor 54converts an image input through the camera module 50 to image data fortransmission. Thereafter, the controller 90 sends the image data fortransmission to another party's mobile communication terminal to performa video call (S140). That is, the video calling program loaded into thesignal processor 54 drives the signal processor 54 to convert the imageinput through the camera sensor 52 to digital data optimized withrespect to the image data for transmission. The signal processor 54 thentransmits the digital data to the image processor 60. The imageprocessor 60 transmits the received digital data to the display unit 70while compressing the digital data into image data before transmittingthe resulting image data to the controller 90.

The controller 90 receives the image data from the image processor 60 totransmit it to the other party's mobile communication terminal throughthe wireless communication unit 20. This allows the user of the mobilecommunication terminal 100 to make a face-to-face video call with theother party while seeing a motion video being transmitted by the otherparty.

Next, the mobile communication terminal 100 determines whether a requestto take an image is received (S150). The user manipulates theimage-taking key 42 to store an image being currently input through thecamera module 50 as separate image data (“image data for storage”). Thecontroller 90, having received the request to take an image, receives animage signal, in other words, raw data, directly from the camera sensor52 (S160).

The image data for storage may be extracted from the digital data outputthrough the signal processor 54 or from image data output through theimage processor 60 for storage. However, in both of these cases, theextracted image data has a low resolution because it is optimized withrespect to a motion video image for transmission. Thus, in an exemplaryembodiment of the present invention, the image data for storage isproduced using an image signal output from the camera sensor 52 beforebeing optimized for conversion. The image signal output from the camerasensor 52 may be a YUV, RGB or similar signal.

When an image signal is input from the camera sensor 52 to thecontroller 90, the controller 90 converts the image signal, which isinput as analog data, into digital data and compresses the digital datato produce image data for storage (S170). In this case, the controller90 generates image data for storage having a visual qualitycorresponding to a resolution that may be preset by the user. That is,the controller 90 produces a high quality image having the sameresolution as image data being stored in a still image taking mode.

After the image data for storage has been produced, the controller 90controls the storage unit 80 to store the image data for storage (S180).The controller 90 then determines whether there is a request toterminate the video call (S190). If a request to terminate the videocall is not received, the controller 90 repeats the steps S140 throughS180. Thus, as the number of repetitions of the steps S140 through S180increases, the amount of image data being stored in the storage unit 80increases.

If a request to terminate the video call is received (S190), thecontroller 90 controls the display unit 70 to display a messagerequesting whether to display the image data being stored in the storageunit 80 (S200). If the user requests display of the stored image data instep S210, the controller 90 controls the display unit 70 to display thestored image data (S220).

If the user requests deletion of the stored image data being displayedon the display unit 70 (S230), the controller 90 deletes the storedimage data displayed on the display unit 70 from the storage unit 80(S240). Next, the controller 90 checks whether another stored image dataexists (S250). If another stored image data exists, the controller 90controls the display unit 70 to display the stored image data forstorage (S220). If another stored image data does not exist, thecontroller 90 determines that there is no more image data to bedisplayed on the display unit 70 and converts the mode of the mobilecommunication terminal 100 to a standby mode.

If at least one additional image data is stored in the storage unit 80,the controller 90 controls the display unit 70 to sequentially displaythe stored image data. That is, the steps S220 through S250 are repeatedfor each stored image data. If a specific key (not shown), such as adirectional arrow or volume control key, is input by the user while onestorage image data is displayed (S232), the controller 90 controls thedisplay unit 70 to display another stored image data. Thus, the user cansee all the image data stored during a video call.

FIGS. 3A and 3B are a flowchart illustrating a method for taking imageson a mobile communication terminal according to another exemplaryembodiment of the present invention.

Referring to FIGS. 1, 3A, and 3B, steps S310 through S370 in FIG. 3A aresubstantially the same as their counterparts (steps S110 through S170)in FIG. 2A, and thus a detailed explanation thereof is not given here.After image data for storage has been produced in step S370, thecontroller 90 controls the storage unit 80 to temporarily store theimage data (S380). Alternatively, the image data may be stored in abuffer memory (not shown) within the controller 90 or other memorylocations.

After the image data has been temporarily stored during the video call,the controller 90 determines whether there is a request to terminate thevideo call (S390). If a request to terminate the video call is notreceived and the image-taking key 42 is input again, the controller 90repeats the steps S340 through S380. As the number of repetitions of thesteps S340 through S380 increases, the amount of image data beingtemporarily stored in the storage unit 80 increases.

If a request to terminate the video call is received in the step S390,the controller 90 controls the display unit 70 to display a messagerequesting whether to display the temporarily stored image data (S400).The message contains buttons representing ‘display image data’ and‘automatically save image data.’ By inputting one of the buttons, theuser can select whether to display image data temporarily stored duringthe video call on the display or whether to automatically save all ofthe temporarily stored image data without checking them.

If the user requests display of the image data (S410), the controller 90controls the display unit 70 to display the temporarily stored imagedata (S420) simultaneously with a message requesting whether to save ordelete the image data displayed on the display unit 70.

After watching the displayed image data, if the user requests that it besaved (S430), the controller 90, having received the user's request,controls the display unit 70 to display a window for inputting a filename for the displayed image data. When the user inputs the file name(S440), the controller 90 controls the storage unit 80 to store thedisplayed image data as the file name (S450). Otherwise, if the stepS440 is omitted, the controller 90 may randomly assign a file name tothe displayed image data for storage.

If the user requests deletion of the temporarily stored image data(S432), the controller 90 deletes the displayed image data (S434).

The controller 90 then checks whether another temporarily stored imagedata exists (S460). If another temporarily stored image data exists, thecontroller 90 controls the display unit 70 to display the temporarilystored image data for storage (S420). That is, the controller 90 repeatsthe steps S420 through S450. If another temporarily stored image datadoes not exist, the controller 90 determines that there is no more imagedata to be stored and converts the mode of the mobile communicationterminal 100 to a standby mode.

If the user requests the displayed image data to be automatically saved(S412), the controller 90, having received the user's request, randomlyassigns a file name to the temporarily stored image data (S414) andcontrols the storage unit 80 to store the image data (S416). In thiscase, when a plurality of image data have been temporarily stored, thecontroller 90 assigns a file name to each image data and controls thestorage unit 80 to store the image data. This process is repeatedlyperformed until all of the image data are automatically saved.

As described above, a method for taking images on the mobilecommunication terminal 100 enables production of image data for storageusing the controller 90 instead of the signal processor 54, thusproviding high quality image data for storage to a user without havingto terminate a video call.

While the present invention has been particularly shown and describedwith reference to exemplary embodiments thereof, it will be understoodby those of ordinary skill in the art that various changes in form anddetails may be made therein without departing from the spirit and scopeof the present invention as defined by the following claims and the fullscope of equivalents thereof. For example, while in the abovedescription, a high quality still image is stored in the storage unit 80during a video call, a motion video image can be stored therein.Further, the present invention can be applied to a mobile communicationterminal having a camera function and any other type of electronicdevice supporting video calls.

As described in the foregoing, a method for taking images on a mobilecommunication terminal enables production and storage of image datausing a controller instead of a signal processor functioning forperforming a video call, thus allowing high quality still or motionvideo image data to be taken and stored while making a video call.

1. A method for taking images on a mobile communication terminal havinga video call function, the method comprising: determining whether thereis a request to take an image during a video call; extracting, if thereis a request to take an image, an image signal output from a camerasensor upon receipt of the request to take an image; and storing theextracted image signal while performing the video call.
 2. The method ofclaim 1, wherein the extracting of the image signal comprises:extracting, upon request to take an image, the image signal whileperforming the video call; and converting the extracted image signalinto image data for storage.
 3. The method of claim 2, wherein thestoring of the extracted image signal comprises storing the image data.4. The method of claim 1, wherein the extracting of the image signalcomprises extracting at least one of raw data that has not beenprocessed and raw data that has not been converted.
 5. The method ofclaim 2, wherein the converting of the extracted image signal comprisesconverting the image signal into at least one of still image data andmotion video data.
 6. The method of claim 2, further comprising:determining whether there is a request to terminate the video call; andterminating the video call if there is a request to terminate the videocall.
 7. The method of claim 6, further comprising displaying the storedimage data.
 8. The method of claim 7, wherein the displaying of thestored image data comprises: displaying a message requesting whether todisplay the stored image data; and displaying, if a request is receivedto display the image data, the stored image data.
 9. The method of claim8, further comprising deleting the displayed image data if there is arequest for deletion.
 10. A method for taking images on a mobilecommunication terminal having a video call function, the methodcomprising: determining whether there is a request to take an imageduring a video call; extracting, if there is a request to take an image,an image signal output from a camera sensor upon receipt of the requestto take an image; converting the image signal to image data for storage;temporarily storing the image data, while performing the video call;terminating the video call; and storing the temporarily stored imagedata.
 11. The method of claim 10, wherein the extracting of the imagesignal comprises extracting at least one of raw data that has not beenprocessed and raw data that has not been converted.
 12. The method ofclaim 10, wherein the converting of the extracted image signal comprisesconverting the image signal into at least one of still image data ormotion video data.
 13. The method of claim 10, wherein the terminatingof the video call comprises: determining whether there is a request toterminate the video call; and terminating the video call if there is arequest to terminate the video call.
 14. The method of claim 10, whereinthe storing of the temporarily stored image data comprises: inputting afile name for the image data; and storing the image data as the inputfile name.
 15. The method of claim 10, further comprising: displaying amessage requesting whether to display or automatically save thetemporarily stored image data; and displaying, if a request is receivedto display the temporarily stored image data, the temporarily storedimage data.
 16. The method of claim 14, wherein the storing of thetemporarily stored image data further comprises automatically saving thetemporarily stored image data for storage, if a request is received toautomatically save the temporarily stored image data.
 17. The method ofclaim 16, wherein the automatically saving of the temporarily storedimage data for storage comprises: inputting a file name for the imagedata; and storing the image data as the input file name.
 18. The methodof claim 15, wherein the temporarily stored image data displayed in thedisplaying of the temporarily stored image data step is deleted uponrequest for deletion.
 19. A mobile communication terminal having a videocall function, comprising: a determiner for determining whether there isa request to take an image during a video call; an image extractor forextracting, upon receipt of a signal indicating a request to take animage from the determiner, an image signal output from a camera sensorduring the video call; an image converter for converting the imagesignal extracted by the image extractor into image data for storage; andan image storage unit for storing the image data output from the imageconverter.
 20. The terminal of claim 19, further comprising an imageprocessor for displaying the image data stored in the image storage uniton a screen and deleting, upon request for deletion, the displayed imagedata.
 21. A method for taking images on a mobile communication terminal,the method comprising: performing a video calling function using acamera module having a camera sensor on a mobile communication terminal;receiving a request to take an image during the video call; extractingan image signal output from the camera sensor during the video call uponreceipt of the request to take an image; and storing the extracted imagesignal during the video call.
 22. The method of claim 21, wherein theperforming of the video calling function using the camera modulecomprises processing the image signal output from the camera sensor by asignal processor.
 23. The method of claim 22, wherein the extracting ofthe image signal output from the camera sensor comprises transmittingthe image signal to a controller.
 24. The method of claim 23, whereinthe transmitting of the image signal to the controller comprisestransmitting at least one of raw data that has not been processed andraw data that has not been converted.